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Abstract 


This  final  report  summarizes  research  for  a  one-year  project. 
Abstracts  for  the  two  scientific  reports  are  given,  and  some  new 
results  art  included  on  reduction  of  context-free  grammars,  decoding 
binary  block  codes  on  Q-ary  output  channels,  a  procedure  for  decoding 
binary  product  codes,  on  the  minimum  weight  code  words  of  a  certain 
class  of  cyclic  codes,  distance  property  of  the  dual  codes  of  polynomial 
codes  and  on  shortened  Reed-Muller  codes. 
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Part  One 

Summary  of  Project  Research 

The  purpose  of  this  project  is  to  attain  a  better  understanding  of 
important  error-correcting  codes  and  the  mathematical  theory  of  languages 
through  research  on  such  topics  as 

a)  Further  algebraic  properties  of  polynomial  codes. 

b)  Majority-logic  decoding  for  the  dual  of  polynomial  codes. 

c)  Weight  structure  of  Reed-*'Jler  codes  and  their  related  codes. 

d)  Construction  of  good  convolutional  codes  for  random  error 
correction. 

e)  Reduction  of  context-free  grammars. 

f)  Finite  automata. 

The  research  on  the  project  over  the  past  year  has  been  reported 
in  two  scientific  reports,  this  final  report,  and  three  journal  papers 
and  two  conference  presentations.  One  report  deals  with  majority- logic 
decoding  for  the  duals  of  primitive  polynomial  codes,  one  with  the 
construction  of  a  class  of  majority- logic  decodable  codes.  The  reports 
and  their  abstracts  are  listed  in  Appendix  A,  and  papers  are  listed  in 
Appendix  B.  This  report  includes  the  following  new  material  un  research: 

Part  Two:  Reduction  of  Context-Free  Grammars 

Part  Three:  On  Decoding  Binary  Block  Codes  on  Q-ary  Output 
Channels 

Part  Four:  A  Procedure  for  Decoding  Binary  Product  Codes 

Part  Five:  On  the  Minimum  Weight  Code  Words  of  a  Certain  Class  of 
Cyclic  Codes 

Part  Six:  An  Upper  Bound  on  the  Minimum  Distance  of  the  Dual  rodes 
of  Polynomial  Codes 

Part  Seven:  On  Shortened  Reed-Muller  Codes. 
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Part  Two 


Reduction  of  Context-Free  Grammars 

by 

T.  Kasami 

The  following  problem  has  been  studied.  Given  a  context-free 

grammar  G,  find  a  context-free  grammar  with  a  desirable  property  among 

those  grammars  which  are  similar  to  G  in  structure. 

For  simplicity,  context-free  grammar  G  is  assumed  to  be  reduced 

[1]  and  to  have  no  e-rule  and  cyclic  rules.  Let  x  =  A,  ...  A  be 

In 

a  sentence  of  L(G),  the  context-free  language  generated  by  G,  and  let 

d  denote  a  derivation  tree  for  x.  By  phrase  [A.  ...  A.]  of  d,  we  mean 

s  J 

a  phrase  which  covers  subsequence  A, ...A.  exactly.  There  might  be  two 

*  J 

or  more  phrases  in  d  which  cover  A,... A.  exactly. 

We  introduce  a  notion  that  a  context-free  grammar  G2  structurally 
approximates  another  context-free  grammar  G1 .  By  G^G^  we  mean  that 

a)  G^  and  G^  generate  the  same  language,  i.e.,  L(G^)  =  L(G2)  . 

b)  For  any  derivation  tree  d,  of  a  sentence  x  =  A,  ...A  in 

I  l  n 

G-j ,  there  is  a  derivation  tree  d2  of  x  in  G2  such  that  for  any 

phrase  [A. ...A.]  of  d, ,  here  is  a  sequence  of  phr^es  [A.  ...A.  .], 

J  yl 

[A.  ...A,  ,],  .  .  .  ,  [A.  ...A.]  in  d,  with  1  <  a  <  h  and 

il  =  1  • 

By  definition,  if  G2  is  unambiguous,  then  G2~^G1  implies  that 
G1  and  G2  are  structurally  equivalent  [2,3,4],  and  if  G]  and  G?  are 
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1  1 

structurally  equivalent,  then  G-j — »  and  G2 — G-j  .  The  notion 

of  structural  equivalence  is  too  restricted  for  some  practical  appli¬ 
cations.  Without  affecting  the  generating  power  of  a  grammar,  a  pro¬ 
duction  rule  may  be  replaced  by  some  separate  rules,  or  some  rules 
are  combined  into  a  single  rule.  However,  these  elementary  trans¬ 
formations  do  not  preserve  structural  equivalence.  On  the  other  hand, 
if  is  derived  from  G-j  by  a  set  of  the  elementary  transformations 

L. 

stated  above,  then  for  some  h  [4]. 

h 

Theorem  1:  Given  h,  G^  and  G^,  it  is  decidable  whether  Gg— ■ . 

This  theorem  is  proved  by  modifying  the  procedure  for  deciding 
"k-structural-equivalence"  described  in  [4]. 

A  context-free  grammar  G  with  no  two  rules  having  the  same  right 
side  is  called  a  backwards-deterministic  grammar  [2].*  Two  nonterminal 
symbols  X  and  Y  of  a  backward-deterministic  grammar  G  are  equivalent 
if  the  grammar  derived  from  G  by  replacing  X  and  Y  by  a  single  new 
nonterminal  symbol  is  backwards-deterministic  and  structurally  equi¬ 
valent  nonterminal  symbols  is  said  to  be  reduced.  A  procedure  for 
transforming  a  given  grammar  G  into  a  reduced  backwards-deterministic 
grammar  structurally  equivalent  to  G  is  known  [2,5].  Two  reduced 
backwards-deterministic  grammars  are  structurally  equivalent  if  and 
only  if  they  are  isomorphic  to  each  other  [2]. 

Theorem  2:  Let  P  be  a  property  of  context-free  grammars  which  is 
preserved  by  the  transformation  to  a  reduced  backwards-deterministic 
grammar. **Then,  given  G  and  h,  it  is  decidable  whether  there  is 

G'  with  property  P  such  that  G'-^G  . 

This  theorem  is  proved  by  presenting  a  procedure  for  finding  G' 
if  any.  The  procedure  is  a  generalization  of  the  one  described  in  [5]. 
Corollary  1:  Given  G,  k,  and  h,  it  is  decidable  whether  there 

L. 

exists  LR(k)  grammar  G"  such  that  G'—*G  . 

*  Two  or  more  initial  symbols  are  admitted. 

**  We  assume  that  it  is  decidable  whether  a  context-free  grammar  has 
property  P. 
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A  procedure  for  finding  such  G  if  any  has  been  devised.  Also, 
the  procedure  described  in  [5]  can  be  generalized  to  one  for  finding 
a  grammar  with  the  minimum  number  of  nonterminal  symbols  or  production 
rules  among  those  grammars  which  h-approximate  a  given  grammar  in 
structure  for  given  h. 
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Part  Three 


Decoding  Binary  Block  Codes  on  Q-ary  Output  Channels* 

by 

E.  J.  Weldon,  Jr. 

1.  Introduction 

In  many  communication  systems  the  demodulator  must  make  a  "hard" 
binary  decision  after  examining  the  received  waveform.  This  hard 
decision  causes  a  loss  in  channel  capacity  and,  more  importantly,  a 
reduction  in  the  error  exponent  at  all  rates  below  capacity.  However, 
in  systems  using  coding  to  improve  reliability,  decoding  is  considerably 
simpler  if  the  decoder  processes  only  binary  digits.  In  practical 
situations  this  can  more  than  compensate  for  the  increased  probability  of 
error. 

This  paper  presents  a  technique  for  decoding  binary  block  codes  in 
situations  w^ere  the  demodulator  quantizes  the  received  signal  space 
into  Q  -  2  regions.  The  method,  referred  to  as  Weighted  Erasure  Decoding, 
is  applicable  in  principle  to  any  block  code  for  which  a  binary  decoding 
procedure  is  known. 

Ir,  section  1  of  this  paper.  Weighted  Erasure  Decoding  is  introdu.ad. 

In  section  2  two  practical  methods  of  implementing  this  decoding  procedure 
are  described.  In  section  3  we  examine  the  performance  of  the  (23,  12) 

Gol ay  code  used  on  the  additive  white  Gaussian  noise  channel  and  decoded  with 
Weignted  Erasure  Decoding  for  various  values  of  Q.  !t  is  shown,  as  expected, 
that  even  small  values  of  Q  yield  substantial  improvements  over  strictly 
binary  decoding. 

It  is  interesting  to  observe  that  all  three  of  the  practical  decoding 
procedures  for  convolutional  codes  --  sequential  decoding,  threshold 


*  This  part  was  supported  in  part  by  NASA  grant  NGL- 12-004-046 
and  by  AFCRl  contract  F 1 9623- 70- C- 0082. 
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decoding  and  Viterbi  decoding  --  are  readily  adapted  to  Q-ary  output 
channels.  Because  of  its  simplicity.  Weighted  Erasure  Decoding  may  permit 
block  codes  to  be  competitive  with  convolutional  codes  on  some  soft-quantized 
channels . 

2.  Code  Structure 

Assume  that  a  binary  (n,k)  code  with  minimum  Hamming  distance  d  is 
used  on  a  memoryless  channel  whose  output  can  assume  any  one  of  Q 
possible  values.  We  wish  to  devise  a  procedure  f rr  decoding  this  code 
which  will  take  into  account  the  probabilities  of  the  different  output 
symbols. 

Consider  the  memoryless  channel  whose  transition  diagram  is  shown 
in  Figure  1.  The  Q  levels  are  ordered  according  to  their  likelihood 
ratios;  that  is 


Pr(0/L.)  ^  Pr(0/Li+1) 

PrO/l^)  Pr{l/L.+1) 


for  i  *  0,  1 ,  . . . ,  Q-l  . 

We  will  associate  with  each  of  the  channel  transitions  a  positive 
real  number  called  the  w-we^ght  as  follows: 


-7- 


Transitions  ! 

w-weiqht 

lq-i 

.  o  -*• 

Lo 

w0 

LQ-2 

,  0  - 

L1 

W1 

L1 

,  o  - 

LQ-2 

wQ-2 

‘  L0 

,  0  - 

lq-i 

WQ-1 

/l) 

Pr(Ln  JO) 


Transition  diagrt>.  of  a  memoryless 
channel  with  two  inputs  and  Q  outputs 


I 


To  permit  maximum  likelihood  decoding  with  equiprobable  inputs,  it 
is  necessary  to  choose  the  weights  to  be  proportional  to 


-log  Pr(L.  j  0} 


(1) 


However,  in  the  decoding  procedure  presented  in  this  paper  certain 
constraints  are  necessarily  placed  on  the  w^.  First  of  all,  it  is  necessary 
to  choose  Wg=  0  .  Secondly,  for  notational  convenience  we  choose  Wq_1=  1  . 

These  constraints  and  Eq.  (1)  then  c,,ggest  the  restriction  that 


0  =  wQ  <  W]  < 


1  wQ-2  1 


w 


Q-l 


=  1 


(2) 


The  final  restriction,  necessary  for  Weighted  Erasure  Decoding,  is 


wi 


w, 


Q-l-i 


(3) 


This  last  restriction  may  preclude  choosing  the  w^  according  to  Eq.  2. 

Because  of  these  restrictions,  Weighted  Erasure  Decoding  will  always  be 
inferior  to  maximum  likelihood  decoding,  although  perhaps  not  significantly 
so.  In  order  to  minimize  the  magnitude  of  the  resulting  degradation,  it 
seems  desirable  to  choose  the  w^  to  be  close  to  the  values  given  by  Eq.  2. 

We  now  define  the  w-di stance  between  two  levels  as  follows. 

dw(Li*L0}  =  dw(L0’Li>  =  wi  •  <4a> 

dw*Li,LQ-l)  =  dw(LQ..l,Li)  "  wQ-l-i  (4b) 
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for  all  i.  The  other  distances,  d  (L.,L.),  j/0  or  Q-l,  are  unimportant 

W  J  j 

in  this  paper;  however  for  completeness  we  can  define 

dw(Li*Lj>  =  <4c> 

Now  Eqs.  4b  and  4c  can  be  combined  to  give  Eq.  3,  explaining  in  part  the 
r.eed  for  this  constraint.  As  defined,  w-distance  is  a  true  metric, 
satisfying,  symmetry,  reflexivity,  and  the  triangle  inequality.  In  fact, 
for  all  i, 

dw^L0‘LQ-l^  =  VL0,L1^  +  £MLi’LQ-l)  ^ 

The  w-weight  of  the  error  in  the  vth  transmitted  digit,  0  <  v  <  n-1, 
will  be  denoted  ev.  The  following  theorem  characterizes  the  error-correcting 

capability  of  binary  codes  on  this  channel: 

Theorem  1 :  A  binary  (n,k)  code  with  minimum  Hamming  distance  d  can 
correct  any  error  pattern  such  that 

n-1 

K  ■  E  <  d/2 

v=0 

Proof:  The  w-uistance  between  code  words  is  at  least  d,  the  minimum 
Hamming  distance  of  the  code.  If  an  error  pattern  of  w-weight  E  <  d/2 
occurs,  the  received  vector  is  w-distance  E  from  the  transmitted  code  word. 
Now  assume  that  another  c^de  word  is  w-distance  E'<  E  from  the  received 
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word.  By  Eq.  5  this  would  imply  that  the  distance  between  this  code  word 
and  the  transmitted  one  is  E  +  E"  <  d.  But  this  is  impossible,  so  there 
exists  no  code  word  closer  to  the  received  vector  than  the  transmitted 
word,  and  the  theorem  is  proved. 

Let  N.j  denote  the  number  of  error  digits  of  weight  w^. 

Corollary  Any  error  pattern  is  correctable  provided 

Q-l 

J  N.w.  <  d/2  (7) 

Example.  For  Q=3,  the  three  outputs  of  the  channel  can  be  taken  as 
1 ,  0  and  erasure.  In  this  case  the  only  possible  choice  for  the  w.., 
subject  to  the  constraints  of  Equations  2  and  3,  are  Wq=0-  w-]=.5, 
and  w2=1  .  Then 

n-1 

y  e  a  2N,  +  N,  <  d 
v=0  v  21 

This  is  the  well-known  result  for  the  binary  symmetric  erar,,re 
channel.  It  is  interesting  to  note  that  for  all  larger  values  of 
Q,  the  constraints  of  Eqs.  2  and  3  do  not  completely  specify  the  w... 

Forneyfll]  has  proved  Theorem  1  and  its  corollary  in  a  more  general  form; 
in  particular,  the  constraint  of  Eq.  3  is  not  employed  in  his  proof.  We 
use  the  constraint  here  because  it  is  necessary  In  the  sequel  and  results 
in  a  somewhat  simpler  theorem  and  proof. 
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Error  correction  procedures  which  employ  the  w-distance  metric  are 
referred  to  in  this  paper  as  Weighted  Erasure  Decoding.  In  the  next 
section  we  present  two  practical  methods  of  implementing  Weighted 
Erasure  Decoding  which  permit  the  correction  of  all  error  patterns  of 
w-weight  less  than  d/2  and  many  of  higher  weight. 

3.  Implementation 

For  any  choice  of  the  w..  it  is  possible  to  find  a  set  of  r<  (Q+l)/2 
positive  real  numbers  v-p  v2,  •••  ,  vr  such  that  for  all  i 


vr  + 


(r-l)i 


r-1 


+ 


Ali  V1 


(8) 


and  such  that 


1 


The  A's  are  binary  digits. 

For  the  vth  digit  of  the  received  vector  the  demodulator  output 
will  consist  of  r  binary  digits  a^,  . a1v  and 

received  word  can  be  represented  as  an  r  x  n  array  of  binary  digits  as 
shown  in  Figure  2.  Since  this  array  must  be  stored  by  the  decoder,  for 
a  given  value  of  Q  it  is  advantageous  to  choose  r  to  be  as  small  as 
possible. 

3.1.  In  the  General  Case 

Given  that  a  binary  decoding  technique  capable  of  correcting  all  error 
patterns  of  Hamming  weight  less  than  d/2  and  perhaps  others  is  available, 
decoding  for  the  Q-ary  channel  can  be  accomplished  as  follows.  Decode  each 
of  the  rows  of  Figure  2  using  the  decoder  for  the  binary  code.  For  the 
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a  ro.:  record  F  ,  the  number  of  changes  made  in  this  row.  The  quantity 

1L 

F  is  related  to  the  number  of  bit  errors  in  the  a  n  row,  E  as  follows: 
o  o 


F  *  E  ;  E  <  ~ 
a  a  ’  a  2 

Fa  =  ;  (correct  decoding)  Ea  >.  j 


(10) 


E„  >  F  >  d-E  ;  (incorrect  decoding)  E  >  I 
a  ~  a  -  a  a  d 


Note  that  the  total  w-weight  of  the  error  pattern  is 

E  =  Jo =  j, 


Relative 

Weight 


Vn-1) 

ar(n-2) 

ar0 

°(r-l ) (n-1) 

a(r-l)(n-2) 

-  -  -  ■  --  -  i  -  -i 

•  •  • 

a(r-l)0 

• 

4 

aUn-l) 

al (n-2) 

JlO _ 

Figure  2.  Representation  of  a  received  word. 
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Now  following  Reddy[10]  we  assign  to  each  row  a  Reliability  Indicator 


"a  ’  d'2Fa 


(12) 


Consider  the  tentatively  decoded  digits  of  the  first  column  of  the 
array  of  Figure  2.  Certain  of  these  digits  are  1 ' s »  the  others  are 
0's.  Let  and  Sg  denote  the  index  set  of  the  rows  corresponding 

to  Vs  and  0's,  respectively,  in  the  first  column  of  the  tentatively 
decoded  array. 

The  decoding  rule  can  now  be  stated.  Choose  the  first  information 
digit  to  be  a  0  if 


l 


R„v„ 

a  a 


>1 


R.v 
a  o 


(13) 


Otherwise  choose  this  digit  to  be  a  1.  It  must  now  be  shown  that  this 
rule  guarantees  the  correction  of  all  error  patterns  of  w-weight 
E  <  d/2  . 

Assume  a  code  word  C  is  transmitted  and  denote  the  first  bit  of 
this  word  as  the  binary  digit  c.  Now  in  the  absence  of  errors  the 
demodulator  output  r-tuple  will  consist  of  r  c's,  s-’nce  LQ  corresponds 


to  the  all -zero  and  Lq_-j  to  the  all-ones  r-tuple. 
In  this  case 


(See  Eqs.  8  and  9) 


R  v  ■  d 
a  o 


and 


R  v  =0 

a  a 


-14- 


where  c  denotes  the  complement  of  the  binary  digit  c. 

If  an  error  pattern  of  w-weight  less  than  d/2  occurs,  then 

l  R„v„  =  l  v„(d  -  2F_) 
s  a  o  k  a  a 

c  ^c 

>  d  l  v  -  2  l  v  E 
~  ?  a  £  a  a 

c  c 

Some  rows  are  decoded  incorrectly  and  result  in  the  first  bit  being 
c.  Thus 


i 


(14) 


i  R  v  =  I  v  (d  -  2F  ) 
*  a  o  k  a  o' 

c  3c 


1  d  y  va  -  2  y  va(d  -  E0) 


=  -d  l  v  +  2  l  v  E 
k  0  £  a  o 


Then  Equ„dons  14  and  15  give 


l  RnVrr  “  I  RrtVrr  >  d  I  Vn  "  2  l  VX 

s  0  0  5-  0  °  -  o-l  0  0-1  0  c 


From  Eqs.  9  and  11  we  have 


R  v  >  dw 
oo- 


Q-l 


2E 


(15) 


06) 


07) 
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If  the  error  pattern  weight,  £  <_  (dWQ_i  -  i )/2,  then  l  R0vq  __  T  R0v0 

Sc  h 

and  the  decoder  correctly  decodes  the  first  informat' jrt  digit. 

All  other  digits  can  be  correctly  decoded  in  a  similar  manner. 

In  situations  where  only  a  bounded  distance  decoder  is  available 

for  the  binary  code  it  is  advantageous  to  define  R„  *  0  if  an  error 

0  ^ 

pattern  of  Hamming  weight  d/2  or  greater  is  detected  In  the  o  row 
by  the  binary  decoder.  It  can  be  shown  that  all  error  patterns  of 
w-weight  E  <  d/2  are  also  correctable  with  this  modified  Reliability 
Indicator;  since  rows  with  R  =  0  are  ignored  by  the  decoder,  the  proof 
above  can  be  carried  through  considering  only  rows  with  R  >  0. 


3.2.  When  the  Code  is  Majority-Logic  Decodable 

For  simplicity  the  binary  (n,k)  code  Wk  1  be  taken  to  be  completely 
orthogonal izable  in  one  step.  That  is,  we  assume  that  it  is  possible  to 
construct  e  actly  d  orthogonal  estimates  of  any  code  digit.  The  extension 
to  L-step  decodable  codes  is  not  difficult. 

The  decoder  for  a  majority-logic  decodable  binary  cyclic  code  used 
on  an  Q-ary  output  channel  is  shown  in  Figure  3.  Basically  it  consists 
of  r  binary  decoders  and  a  single  majority  gate.  The  majority  gate  has 
rd  inputs;  d  have  weight  vr>  d  have  weight  vf ,  ...  ,  d  have  weight 

v 2  and  d  have  weight  v^. 

In  Figure  3  each  of  the  r  Syndrome  Registers  is  a  circuit  which 
divides  by  g(X),  the  generator  polynomial  of  the  code.  The  inputs  to 

the  register  are  the  n  binary  digits 

ao(n-l ) ’  ao( n-2)’  ***  ’  aol ’  aoO  (18) 

Similarly  the  Information  Register  stores  the  k  "information" 
symbols 
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ao(n-l )  ’  aa(n-2) . ao(n-k) 

The  n- tuple  (18)  is  treated  as  a  possibly  erroneous  word  in  the 
(n,k)  code.  Its  syndrome  is  calculated  and  the  d  orthogonal  estimates 
of  ao(n-  are  formed.  These  are  used  as  inputs  to  the  majority  gate 

where  each  is  weighted  by  the  factor  v  .  The  ru  binary  adding  circuits 

which  may  be  needed  to  form  the  inputs  to  the  majority  gate  have  been 
omitted  from  Figure  3  to  simplify  the  drawing. 


Input 

£  Weights 


Figure  3.  Block  diagram  representation  of  a  majority 
logic  decoder  for  a  Q-ary  output  channel. 
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We  now  consider  the  error-correcting  capability  of  the  decoder  of 
Figure  3. 

Theorem  2:  An  (n,k)  code  completely  orthogonal! zable  in  one-step 
with  minimum  Hamming  distance  d  used  on  a  Q-ary  output  channel  can 
correct  all  error  patterns  of  w-weight  less  than  d/2  using  a  one-step 
majority  logic  decoder.  (Figure  3) 

Proof:  Assume  that  an  error  pattern  of  w-weight  E  less  than  d/2 
occurs.  Let  c  denote  the  value  of  the  first  information  bit.  We  wish  to 
show  that  the  output  of  the  majority  gate  gives  the  correct  value  of  this 
bit  regardless  of  the  location  of  the  errors. 

An  error  of  magnitude  e  in  position  v  is  represented  as 


'v  *  ervvr  +  e(r-l)vvr-l  +  •••  ‘  elvvl 


where  the  e's  are  binary  digits.  Then 


n-1  n-1 

/  y  e_  +  .  .  .  +  v,  y  e-, 

r  tr,  rv  1  lv 


"  Ervr  *  Er-lVl  *  ■  •  ■  *  E,v,  ■  E  <  d/2 


where  E  is  the  number  of  binary  errors  in  the  o**1  row  of  the  array  of 

0 

Figure  3. 

Now  consider  this  row.  because  the  code  is  completely  orthogo¬ 
nal  izable  it  is  possible  to  construct  d  orthogonal  estimates  of  the  first 
bi :  of  this  word;  these  are  also  estimates  of  the  first  information  bit. 
At  most  E^  of  these  estimates  will  have  value  c;  the  others  have  value  c. 
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These  are  each  weighted  by  the  factor  v^  by  the  majority  gate.  Sunning 

on  a  gives  an  upper  bound  on  the  total  number  of  incorrect  timates  of 
the  first  information  digit: 

r 


But  by  hypotheses, 


E  <  d/2 

so  strictly  less  than  half  of  the  weighted  inputs  to  the  majority  gate 
give  value  c.  Therefore  the  value  of  this  output  is  c  and  the  first 
information  symbol  is  decoded  correctly.  If  d  orthogonal  estimates  of 
each  information  bit  can  be  formed,  as  in  a  cyclic  code,  the  entire 
code  word  can  be  decoded  correctly. 

The  above  procedure  is  closely  related  to  Massey's  APP  decoding. [2] 

It  differs  in  that  restriction  [3]  will  cause  some  degradation  in  per¬ 
formance,  on  the  other  hand  the  circuitry  required  to  form  the  inputs  to 
the  majority  gate  will  be  simpler.  Also,  this  procedure  extends  in  a 
straightforward  way  to  l-step  decoding.  After  the  first  step  all  check 
suns  required  in  the  second  step  will  be  correctly  determined  provided 
that  decoding  is  performed  as  above  and  that  the  error  pattern  has  weight 
less  than  d/2.  Subsequent  steps  can  be  identical  to  binary-output  majority- 
logic  decoding, 

4.  Evaluation  of  Weighted  Erasure  Decoding 

It  does  not  seem  to  be  possible  to  calculate  the  probability  of 
erroneous  decoding  for  interesting  codes.  The  alternative,  simulation,  is 
being  performed;  unfortunately  no  results  are  available  at  this  writing. 

In  order  to  give  some  idea  of  the  capabilities  of  this  decoding 
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procedure  however,  we  present  in  Figure  4  performance  curves  for  maxi  mum 
like! ihood  Weighted  Erasure  Decoding.  The  channel  is  the  standard  time- 
discrete  channel  afflicted  by  zero-mean  additive  white  Gaussian  noise; 
the  equally  likely  antipodal  signals  have  energy  E$  and  the  noise  has 

variance  Kq/2.  The  code  employed  is  the  (23,12)  Go! ay  code  and  so  the 

energy  per  information  bit,  E^,  equals  Fs (23/12). 

The  curves  are  all  strict  upper  bounds  on  performance  with  the  exception 
of  the  Q-2  curve,  which  is  exact.  The  Q=3,  4  and  8  curves  are  somewhat 
crudely  optimized  on  the  weights  w.  and  threshold  settings.  Interestingly 
enough,  nearly  optimal  performance  is  obtained  in  all  cases  with  evenly 
spaced  thresholds  and  weights  w.*  i/(Q-l). 

It  can  be  shown  that  for  long  codes  decoded  with  the  procedures  of 
Section  2,  the  Q=3  curve  is  roughly  1.4  db  better  than  the  0*2  curve,  tne 
Q  4  curve  is  1.9  db  better,  the  Q“8  curve  is  2.6  db  better,  while  correlation 
decoding  is  3.0  db  better.  Forney[ll]  and  Cahn[14]  have  obtained  identical 
results  for  the  cases  of  Q=3  and  4,  respectively,  using  Generalized  Minimum 
Distance  decoding.  This  indicates  that  Weighted  Erasure  Decoding  is 
asymptotically  as  good  as  maximum  likelihood  decoding. 

For  moderate  signal-to-noise  ratios,  i.e. ,  such  that  p  *  d/2  where 
p  is  the  binary  synmetric  channel  crossover  probability,  Forney[ll]  has 
shown  that  Generalized  Minimum  Distance  decoding  offers  no  improvement 
over  binary  decoding.  Weighted  Erasure  Decoding  corrects  some  error  patterns 
of  w-weight  greater  than  d/2  and  so  may  In  fact  improve  on  binary  decoding 
in  this  range;  it  seems  doubtful  to  the  author  that  any  such  improvements 
will  be  significant,  however.  This  will  be  the  first  question  answered  by 
our  simulation. 
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5.  Summary  and  Conclusions 

The  decoding  procedure  described  in  this  paper  is  applicable,  in 
principle,  to  any  binary  block  code..  Both  of  the  two  means  of  implementing 
this  procedure  correct  all  error  patterns  guaranteed  correctable  by  the 
minimum  distance  of  the  code,  as  well  as  some  patterns  of  higher  weight. 

It  seems  likely,  however,  that  the  fractions  of  these  high  weight  patterns 
which  are  correctable  with  these  practically  implenk.ntable  decoding  tech¬ 
niques  are  less  than  the  fraction  correctable  with  maximum-likelihood 
Weighted  Erasure  Decoding. 

Performance  curves  for  the  Golay  code  decoded  with  maximum-likelihood 
Weighted  Erasure  Decoding  have  been  presented;  these  show  that  as  expected, 
substantial  improvements  over  hard-decision  decoding  are  possible.  The 
efficacy  of  the  two  practical  Weighted  Erasure  Decoding  procedures  has  yet 
to  be  demonstrated,  however. 
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Part  Four 


A  Procedure  for  Decoding  Binary  Product  Codes* 

by 

£.  J.  Weldon,  Jr. 


1.  Introduction 

Product  (iterated)  codes,  despite  their  relatively  poor  random- 
error-correcting  capabilities,  have  been  much  studied.  For  one  thing 
the  codes  are  structurally  interesting,  and  this  structure  has  suggested 
several  effective  and  easily  implemented  decoding  procedures  applicable 
only  to  these  codes. 

These  methods  are  summarized  briefly  below  for  a  2-dimensional 
product  code: 

1)  (Elias[l],  Abramson[2])  The  row  code  words  are  decoded  inde¬ 
pendently;  then  the  column  words  are  decoded.  This  process 
can  be  repeated  a  number  of  times  until  no  further  corrections 
are  possible. 

2)  (Lin  and  Weldon[3],  Gore[4])  When  the  row  and  column  codes 
are  majority  logic  decodable,  the  product  code  is  majority 
logic  decodable. 

3)  ( Reddy[5] )  If  either  factor  (component)  code  is  majority- 
logic  decodable,  then  the  product  code  can  oe  decoded  using 
the  decoders  for  the  factor  codes. 

All  of  these  procedures  have  the  highly  desirable  property  that 
the  decoder(s)  for  the  factor  codes  are  used  to  decode  the  much  longer 
product  code.  However,  Method  1  fails  to  correct  many  error  patterns 
of  weight  less  than  or  equal  to  t  where 


*  This  research  was  supported  in  part  by  NASA  grant  NGL- 12-001 -046  and 
by  AFCRL  Contract  F19628-70-C-0082. 
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t 


(1) 


2 

the  error-correcting  capability  of  the  code.  Methods  2  and  3  correct 
all  patterns  of  weight  t  or  less  and  many  of  higher  weight  but  are 
applicable  to  relatively  few  product  codes. 

In  this  paper  we  present  a  decoding  procedure  for  product  codes 
which  corrects  all  error  patterns  of  weight  (d^  -  l)/2  or  less  (as 

well  as  some  of  higher  weight),  is  applicable  to  all  binary  product 
codes,  and  uses  the  factor-code  decoders  in  a  simple  way  to  decode  the 
product  code.  The  procedure  is  similar  in  concept  to  Reddy's  decoding 
technique[5]  and  draws  heavily  on  the  results  of  Reference  6.  Because 
of  the  limitations  of  this  latter  reference,  the  present  result  applies 
only  to  binary  codes. 

2.  The  Decoding  Procedure 

Consider  the  product  of  an  (n^,k^)  row  code  with  minimum  Hamming 

distance  d^  and  an  (n2 ,k2)  column  code  with  distance  d?  .  Let 

denote  the  number  of  bit  errors  in  the  yth  row.  Decoding  can  be  accom¬ 
plished  in  2  steps: 

1)  Decode  the  row  word;  compute  and  record  ,  the  number 
of  changes  made  in  decoding  this  row,  y  *  1,  2,  . . . ,  ng  . 

2)  Decode  the  column  word  using  Weighted  Erasure  Decoding[6] 
as  explained  below. 

To  simplify  the  presentation  we  will  take  d-,  to  be  odd  i.e. 
d^  =  2t^  +  1  ;  the  case  of  d^  even  follows  directly.  The  column 
decoder  operates  on  a  binary-input,  (d^  +  2)-ary  output  channel.  If 
F  <_  t^  ,  the  digit  in  the  yth  row  and  the  vth  column,  a^v  ,  will  be 
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taken  to  have  value  Lp  if  the  binary  symbol  in  this  position  is  a  0 
and  value  +^_p  if  the  binary  symbol  is  a  1  .  If  F  >  t-j  ,  the  output 

symbol  is  regardless  of  the  associated  binary  digit. 

The  table  below  assumes  that  the  all-zero  word  is  transmitted.  The 
row  originally  contains  E^  errors;  the  row  decoder  makes  changes. 
Of  course,  if  <.  t-j  ,  these  changes  are  corrections;  if  <,  t^l  , 
correction  of  all  errors  may  or  may  not  occur. 


E 

Y 

no.  of  bit  errors 

in  row  y 

F 

Y 

no.  of  changes 
made  in  row  y 

Output  symbol 
a 

YV 

w-weight  of  error 
6y 

Associated  Binary 
digit 

Associated  Binary 
digit 

I 

0 

1 

1 

1 

0 

1 

2 

*1 

>  t]  +  1 

0 

1 

2 

41 

>  t,  +  1 

1 

L0 

L1 

L2 

S 

Lt1+1 

Lt1+1 

0 

1 

2 

t, 

i 

0 

1 

2 

t, 

i 

*1  +  }a* 

it,  +  1 

h 

Lt. 

1 

Lt]+2 

*1 

t1  +  l 

>  d1  -  2 

2 

L2 

Ldrl 

2 

dl  -2 

>  di  -  1 

1 

li 

S 

1 

dl  “  1 

>  d, 

0 

Lo 

Ld1+1 

0 

dl 

*  In  Reference  6  the  e  are  restricted  to  be  integers.  This  is  not 
strictly  necessary  but  multiplying  the  e^  here  by  a  factor  of  2  gives 
integral  weights  and  leaves  the  proof  unchanged. 
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It  now  remains  to  show  that  the  column  decoder  decodes  correctly 
provided  that  t  or  fewer  errors  occurred  in  the  product  code  word. 

To  prove  that  this  is  so,  assume  that  the  all-zero  code  word  is  trans¬ 
mitted  and  consider  the  decoding  of  a  particular  column,  the  v^. 

The  worst  case  occurs  when  the  row  decoder  corrects  no  errors. 

Let  e^  denote  the  w-weight  of  the  error  in  the  y**1  digit.  Then  either 


1) 

2) 


1  L. 

The  ytn  row  contained  no  errors,  hence  no  changes  were  made  by 

the  row  decoder  and  e  =  0  ,  or 

y 

A.  L. 

The  ytn  row  contained  E  errors  where 

Y 


E  >  t,  +  1 
Y  1 


In  this  latter  case, 


Now  since  t  or  fewer  bit  errors  occurred  in  the  product  code  word 

n2 

l  E  i  t  (3) 

y=l  > 

Therefore,  from  Eq.  2, 

n2 

I  e  <  t  (4) 

y»l  1 

but  by  Theorem  1  of  Reference  6,  this  is  precisely  the  necessary  condition 
for  correctly  decoding  the  vth  column.  Therefore  all  error  patterns  of 
Hamming  weight  <.  [(d^  -  l)/2]  are  correctable. 

Example.  Consider  the  product  of  two  binary  codes  with  minimum  Hamming 
distance  3.  The  product  code  has  distance  9  and  so  can  correct  any 
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error  pattern  of  weight  <4  --  including  a  pattern  of  4  errors  which 
form  a  rectangle  in  the  usual  2-dimensional  representation  of  the  product 
code  word.  Again  assume  the  all-zero  word  is  sent. 

After  Step  1  of  decoding,  all  rows  except  the  y-j  and  Y2 tn  have 

e  =  0  ,  F  =0  and  contain  no  errors.  The  other  two  rows  have 

Y  Y 

e  =  2  ,  F  =1  (the  row  decoder  introduces  an  error)  and  contain 

Y  Y 

3  binary  errors  each  after  the  first  step. 

In  Step  2  of  decoding,  for  all  columns  except  Vj  ,  and  , 

iL  1.L 

the  Yj  "  and  y^  bits  are  0  with  F  =  1  and  all  other  bits  are  0  with 
F  =  0  .  Thus  for  these  columns, 

n2 

I  eY  =  2  £  t 

Y=1  Y 

and  correct  column  decoding  results.  For  the  v-.^,  V2^  and  v3th 
columns,  the  y^  and  bits  are  1  with  F  =  1  ,  while  all  other 
bits  are  0  with  F  =  0  .  Hence 

n2 

l  eY  3  4 

Y*1  Y 

and  correct  decoding  results. 

In  conclusion,  it  should  be  remarked  that  since  only  the  F  must 

Y 

be  stored  after  each  row  decoding,  and  since  £  t^+1  ,  the  storage 

requirements  beyond  storing  the  array  itseif  are  minimal.  Also  since 
the  complexity  of  Weighted  Erasure  Oecrd  ig  increases  with  the  number 
of  output  symbols,  it  makes  sense  to  treat  the  code  with  the  smaller 
minimum  distance  as  the  row  code. 
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Part  Five 

A  Remark  on  the  Minimum  Weight  Code  Words 
of  a  Certain  Class  of  Cyclic  Codes 

by 

T.  Kasami 

Very  little  is  known  on  tie  weight  structure  of  subcodes  of  the 
ord  or  high  order  Reed-Muller  code  (or  supercodes  of  the  (m-4)th  or 
lower  order  Reed-Muller  code).  The  following  theorem  on  the  minimum 
weight  code-words  is  a  strengthenea  version  of  Theorem  11  in  (Kasami- 

Lin-Peterson,  1968).  Let  p  be  a  prime.  W  (i)  denote  the  sum  of  the 

P 

coefficients  of  the  radix-ps  form  of  i. 

Theorem:  Let  C  be  a  p-ary  cyclic  code  of  length  pms-  1  with 
generator  polynomial  g(X),  let  a  be  a  primitive  element  of  GF ( pias ) , 

and  let  1  <  c  <  in  .  If  gU1)  =  0  for  every  i  such  that 

o  <  i  <  2(p<n-c)s-;)  , 

W  (i)  <  \m— c)(oJ- 1 1  , 

P 

then  any  code-word  of  minimum  weight  p'n'~c^s-  1  is  a  scalar- 
multiple  cf  the  incidence  vector*  of  an  (m-c)-flat  through  the 
origin  in  tG(m,ps) . 

This  theorem  is  proved  by  showing  that  the  reciprocal  of  the 

locator  polynomial  of  a  code-word  of  weight  p  m’c*s-  1  is  an  affine 
polynomial.  For  fhe  detail,  refer  to  the  proof  of  Theorem  11  in 
(Kasami -Lin- Peterson,  1968).  If  l  in  Theorem  i_  a  proper  supercode 


*  The  component  corresponding  to  the  origin  is  deleted. 


a- 

i 

of  the  code  spanned  by  the  dual  of  the  (fn-c-l)-th  order  Euclidean 

Geometry  code  over  EG(m,ps)  and  the  all  one  vector,  then  a  vector  v 
is  a  minimum  weight  code-word  if  and  only  if  v  is  a  nonzero  scalar 
multiple  of  the  incident  vector  of  an  (m-c)-flat  through  the  origin 

c 

in  EG(m,p  ).  The  minimum  weight  code-words  do  not  span  code  C. 
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Part  Six 


An  Upper  Bound  on  the  Minimum 
Distance  of  Dual  Codes  of  Primitive  Polynomial  Codes 

by 

T.  Kasami  and  S.  Lin 


1.  Introduction 

In  this  part  of  the  report,  an  upper  bound  on  the  minimum  distance 
of  dual  codes  of  primitive  polynomial  codes  [1]  is  derived.  For  several 
cases,  this  upper  bound  is  tight  and  is  equal  to  the  BCH  lower  bound 
for  the  same  class  of  codes  [2,3].  This  upper  bound  can  be  applied  to 
establish  the  exact  minimum  distance  of  a  subclass  of  binary  primitive 
BCH  codes. 


2.  A  Brief  Review  of  Polynomial  Codes 

Let  GF(qms)  be  the  extension  field  of  GF(qs)  where  q  is  a  power 
of  a  prime  p.  Let  a  be  a  primitive  element  of  GF(qms).  Then,  any  non 
zero  element  aJ  ’n  GF(qms)  can  be  expressed  as 


aJ  =  a 


lj 


a2ja 


a3j“2  + 


8  .01 
mj 


m-1 


0) 


for  0  £  j  <  qms-l  ,  where  a.,  is  in  GFfq*).  There  is  one-to-one 


U 


correspondence  between  aJ  and  the  m-tuple  IT  =  (a^,  *  •••  »  amj)  • 

We  call  S'  =  (a-^,  a2j ,  ...  .  amj)  the  coordinate  vector  of  aJ. 

Let  J  -  (Xp  X2,  ...  ,  Xm)  where  X.  is  a  variable  over  GF(qs). 
Define  Qm(u)  as  a  set  of  the  following  polynomials  of  m  variables: 


fQO  =  I C  v  v  X,  x2  . . . 

vlv2,,,vm  ’  ‘ 


V1  vV2  xvm 
m 


(2) 
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such  that 


">  Sv-VGF(qS)  ’ 

1  2  m 

(2)  0<  v.  <qs  for  1  <.  i  <.  m  , 

m 

(3)  l  v.  <  y 

i=l  1 

(4)  f (a, j ,  a2].,  ...  .  a^)  c.  6F(q)  for  0  <  j  <  q"15-  1  , 


where  («„,  . amj)  is 

For  each  polynomial  fOQ  in 
follows: 


the  coordinate  vector  of  aJ. 

Q  (y),  a  vector  v(f)  is  defined  as 


u(f)  =  (vq»  V  u2’  ‘  *  *  1  v  ms  J 

q  -Z 


(3) 


.th 


where  the  j  component 


=  f(alj‘  2j . Vp 

for  0  <  j  <.  qms-2  .  Thus,  i/(f)  is  a  vector  over  GF(q). 

Definition[l]  A  y-th  order  q-ary  polynomial  code  of  length 
qms-l  is  defined  as  the  following  set  of  vectors: 


Cm(y)  *  Mf)  |  fQQ  e  Qm(y)>  •  (5) 

Let  Qq  and  Rq  be  the  quotient  aad  remainder  resulting  from 
dividing  (y+1)  by  (qs-l),  i.e., 

y+1  a  Q0(qs-1)  +  Rg  (6) 
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(7) 


with  0  £  Rq  <  qs-l  .  Let  j  be  the  largest  integer  such  that 

<  qs-R0 

Dividing  qs-RQ  by  qJ ,  we  obtain 

»s  •  Ro  •  +  (8) 


where  1  <  a.  <  q  and  0  ^r.  <  qJ  .  Define  the  following  two  integers, 

J  J 


A  =  Rq  -  1  +  a..qJ 


B  =  qS  -  OjqJ 


(9) 


Let  Aq  and  BQ  be  two  non-negative  integers  less  than  or  equal  to  q-l 
which  are  defined  as  follows: 

Aq  3  Aq5-'*  (mod  qs-l)  for  A  t  qs-l 
Aq  =  A  for  A  -  qs-l  , 


Bq  =  Bq5"^  (mod  qs-l)  for  B  /  qs-l 

=  „s. 


B0  =  B  for  B  =  qM 

Bn  =  Bq  (mod  qs-l)  for  j  =  0  . 


(10) 


Now,  we  construct  hQ  as  follows: 

hQ  =  (qS-l )  +  (qS-Uq5  +  .  ,  .  +  (q5-l)q 


.  .  c  e  (Qn-2)s 

S  n  ,  /_S  t\,S  ,  S  i  u 


(Qq-Ds  Q0s 
+  ¥  0  +  D  “ 0 


Qns  (Q0-l)s 

=  B0q  0  +  (Aq+1 )q  0  -1  . 


OD 
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Let  Dm(y)  be  the  q-ary  dual  code  of  the  y-th  order  polynomial 
code  C  (y).  It  has  been  shown  in  Ref.  2  and  3  that  the  code  Dm(y) 
has  minimum  distance  d  .  at  least  equal  to 


h0  +  1  = 


Q0s  (Qq-1 )s 

0  +  (A0  +  1  )q  0 


(12) 


i.e. 


d  .  >  hn  +  1  . 

min  =  0 


3.  An  Upper  Bound  on  the  Minimum  Distance  of  Dm(y) 


V1  v2 

Consider  x-j  x2  . 


x_  m  with  0  <  v.  <  qS-l  for 
m  =  i  ~ 


1  <  i  <  m.  It  has  been  proved  that 


V, 

r  v  i  v  2  vm-n 

x.eGF{pS)  1  2  * 

1  <  i  <  m 

ss*  rxs 


(13) 


unless  v-,  =  =  .  .  .  =  vm  =  qs-l  [1]  . 


Now,  consider  the  y-th  order  primitive  q-ary  polynomial  code 


Cm(y)  with 


y  -  Q0(q  -i)  +  kq  -  i 


(14) 


where  0  <  RQ  <  qs  -  1  .  Define  the  following  polynomial: 


m-Qo-! 


q-Rn-2 


p(5l)  .  £  1)  Vq0  J.,  (xm-V>  •  “J1 1 


(15) 


where  Wj  e  GF(qs)  The  degree  of  p(X)  is 
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06) 


(»  -  Q0  -  i)(qs  -  1)  +  qS  -  Rq  -  1 


It  follows  from  Eq.  (13)  that  the  vector  v(p)  defined  in  accordance  with 
Eq.  (3)  and  Eq.  (4)  is  orthogonal  to  every  vector  a  in  the  polynomial  code 
Cm(u),  i.e.,  u*u(p)  =0  .  Let  Tr  stand  for  trace.  It  is  clear  that 


Tr[u*u(p)]  =  0  . 


Since  a  is  a  vector  over  GF(q),  thus 


Tr[a*u(p)]  =  u*Tr[u(p)] 

=  a*u[Tr  p(x)3 
=  0  . 


Since  the  vector  v[Tr  p(x)]  is  over  GF(q),  therefore  it  Is  in  the  dual  code 
Dm(u)  of  the  polynomial  code  Cm(u).  The  weight  of  u[Tr  p(x) ]  is 


X 


(Ro  +  2}q 


It  is  clear  that  x  is  an  upper  bound  on  the  minimum  distance  of  Dm(y). 

Theorem  1:  The  minimum  distance  d_.._  of  the  dual  code  D„(y)  of  a 
-  m\n  ro 

primitive  polynomial  code  C^(v)  is  upper  bounded  by 

Qqs-1 

X  =  (Rq  +  2)q  0  .  (17) 


where  Qq  and  RQ  are  quotient  and  remainder  resulting  from  dividing 
v  +  1  by  (qs  -  1). 

For  several  binary  cases,  this  upper  bound  is  tight  and  is  equal  to  the 
lower  bound  of  Eq.  (12),  i.e. 


x  .  h0  ♦  1 


Case  1 :  For  q=2  and  Rq=2-2,  we  have 


„  -  Q0(2S-1)  ♦  2s -3  . 
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By  (17),  the  minimum  distance  dmin  of  binary  code  Dm(jj)  is  upper 
bounded  by 


s  Q0S  -  1 
A  =  ( 2s ) 2  0 

(Q0+l)s  -  1 

=  2  u 

It  follows  from  (7),  (8),  (9)  and  (10}  we  obtain 


08) 


(19) 


Thus,  by  (11),  the  minimum  distance  of  D  (y)  is  lower  bounded  by 


h„  +  1  =  2 


(Q0+l)s  - 


(20) 


From  (18)  and  (20),  we  notice  that  the  upper  bound  and  lower  bound  are 
equal.  Therefore,  we  conclude  that  for  y  =  Qq(2s-1)  +  2s-3  the 

minimum  distance  d  of  Dm(y )  is  exactly  equal  tn 


(Qn+l)s  -  1 
2  u 


(21) 


Case  2:  For  q=2  and  R(^=2s-3,  we  have 


U  ■  Q0(2S-1)  ♦  2S-4  . 


By  (17),  the  minimum  distance  dmin  of  D  (y)  is  upper  bounded  by 


A  * 


1 


(22) 
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By  (7),  (8),  (9)  and  (10),  we  obtain 


Then,  it  follows  from  (11)  that 

s  V  -  1 

hQ+l  *  (2S-1)2°  .  (23) 

From  (22)  and  (23),  we  notice  that  the  upper  bound  and  the  lower  bound 
are  equal.  Thus,  the  code  DmCp )  with  y  *  Qq(2s-1)  +  2s-4  has  minimum 
distance  exactly 

s  Qns  -  1 

d  .  -  (2S-1)2  0 

min 

4.  The  Exact  Minimum  Distance  of  a  Class  of  Primitive  BCH  Code. 

Let  a  be  a  primitive  element  in  GF(2ms).  It  is  known  that  the 
code  Dm(y)  is  a  subcode  of  the  (hg+l)  -  BCH  code  CQ  whose  generator 

polynomial  has 

0  1  2  V1 

Ct  j  Ct  |  Cl  j  •  •  •  >  Q 

as  roots  [1,4].  From  the  conclusion  which  we  obtain  in  t;ase  2,  we  have 
the  following  theorem. 

Theorem  2:  For  dg  -  (2s- 1 ) 2S'S~^  for  1  <  i  <  m-1 ,  the  dQ  -  BQ!  i,ode 
of  length  2ms  -  1  whose  generator  polynomial  has 

0  1  2  V1 

a  .  a  ,  a  ,  .  .  . ,  a 

as  roots  has  minimum  distance  exactly  equal  to 

(2s-l)2i‘s"]  . 
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Due  to  the  symmetry  property  of  primitive  BCH  codes  £5J ,  a  direct 
consequence  of  Theorem  2  is  the  following  corollary. 

Corollary  2:  For  d  =  (2s-l)2£s_1-  1  with  1  <  l  <  m-1,  the 

d-BCH  code  of  length  2ms-  1  whose  generator  polynomial  has 

1  2  d-1 

a  ,  a  a 

as  roots  has  minimum  distance  exactly  equal  to 

(2s-1)2£s“1-  1  . 

Corollary  2  gives  us  some  new  information  about  the  exact  minimum 
distance  of  a  subclass  of  primitive  BCH  codes. 


(24 
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Part  Seven 


On  Shortened  Reed-Muller  Codes 
by 

C  L.  Chen  and  S.  Lin 

1.  Introduction 

The  Reed-Muller  (RM)  codes[l,2]  not  only  provided  the  first 
example  of  a  class  of  multiple-error-correcting  codes,  they  also  have 
the  important  feature  of  being  majority  decodable.  However,  the  code 
length  and  the  code  dimension  of  these  codes  are  rather  sparsely 
distributed.  Very  often  this  hinders  the  adaption  of  these  codes  in 
practical  application. 

Weiss  has  found  a  way  overcome  this  situation  by  puncturing 
some  digits  from  the  RM  codes. [3,4]  The  code  length  of  the  punctured 
codes  is  greater  than  while  the  minimum  distance  of  tne  punctured  codes 
is  less  than  the  original  RM  codes.  Furthermore,  the  punctured  RM 
codes  also  have  the  important  property  of  being  majority  logic  decodable. 

Another  way  to  Increase  the  number  of  codes  from  the  RM  codes  is 
to  shorten  the  RM  codes.  In  this  part  we  shall  introduce  a  way  of 
shortening  the  RM  codes.  The  shortened  RM  codes  have  the  same  minimum 
distance  as  th'_  original  codes.  They  also  preserve  the  feature  of  being 
majority  logic  decodable. 

2.  The  RM  Codes  and  the  Punctured  RM  Codes 

Let  n  *  f'  and  Vq  be  a  vector  of  all  l*s  n-tuple.  In  addition, 

arrange  the  m  n-tuples  v^,  v^,  .  .  -»vmt  in  rows  so  that  the  n 
columns  formed  by  tnem  are  the  all  possible  2™  m-tuples.  Finally, 
define  the  vector  product  of  two  n-tuples  as  follows: 

“  *  <*1>  . a„> 
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v  «  (bp  b2,  .  .  bn) 
u-v  =  (ajbp  a2b2,  ....  anbn) 


Then  the  r-th  order  Reed-Muller  code  is  formed  by  using  as  a  basis 
Vg,  Vp  .  .  vfflt  and  all  vector  products  of  these  vectors  r  or  fewer 
at  a  time.  That  is,  the  generator  matrix  of  the  code  is  of  the  form 


m 

vlv2 


vm-1vm 

V1V2V3 


vm-r+-1  vm-r+2'  ’  'vm 


(1) 


It  can  be  shown  that  the  code  has  the  following  specifications: 
code  length  =  n  =  2m 

Dimension  =  K  =  1  +  +  (2)  A  .  .  .  +  (^) 


minimum  distance  =  d  *  2m"r 


9 
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The  punctured  RT  odes,  or  the  Weiss  codes,  are  obtained  from  the 
RM  codes  by  puncturing  some  digits  of  the  code  words.  Let  us  consider 
the  matrix  Gr  of  Eq.  (1)  and  its  submatrix  G 


G  » 


(2) 


The  punctured  code  is  obtained  by  the  deletion  of  these  columns  of  Gr 

which  have  p+1  or  more  l's  in  the  submatrix  G,  where  p  is  an  integer 
greater  than  r  and  less  than  or  equal  to  m. 

It  can  be  shown  that  the  punctured  code  thus  obtained  has  the 
following  specifications:^] 


code  length  =  nn  =  1  +  (™)  +  (?)  +  .  .  .  +  (?) 


r  (?) 

i=0  1 


P' 
p  <  m 


dimension  =  K. 


1  +(")+...+  (J) 


S  (?) 

i=0  1 


0  <  r  <  p 


minimum  distance 


p-r 


i  (m;r) 

i=0  1 


In  the  following,  we  shall  briefly  describe  the  decoding  procedures 
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for  both  the  RM  codes  and  the  punctured  codes. 

Let  a.  -  .  be  the  information  digit  corresponding  to  the 

1 1 n2* • * 1 j 

vector  v.  v.  .  ..v.  in  the  matrix  G  .  Then  a  code  word  of  the  r-th 
’l  '2  ')  r 

order  RM  code  is  of  the  form 


b  -  (b'j  ,  ^2*  *  ■  * 1 


VO  +  *  ai1f2Vi,''l2  +  J  \V3\\\  +  ■  '  • 


+  l  a.  .  .  v.  v.  ...v. 

M  V 


(3) 


where  i.'s  are  taken  from  1  to  m  and  i.  f  i.  in  each  of  the  summation 
J  J  K 

terms. 

The  decoding  of  the  RM  codes  was  described  in  Ref.  [2,5].  It 
can  be  shown  in  general  that,  for  the  generator  matrix  of  the  r-th 

order  code,  the  columns  can  be  grouped  into  2m_r  disjoint  sets  of  2r 
each,  such  that  the  sum  of  the  columns  in  each  set  has  a  "1"  only  in 
the  position  corresponding  to  the  row  vector  v.  v.  .  .  .  v.  .  Thus, 

'l  '2  V 

there  are  2m-r  independent  determinations  that  can  be  formed  to  solve 

a.  •  .  .  Since  each  error  digit  can  affect  only  one  determination, 

r2*  “r 

a.  .  can  be  determined  correctly  by  a  majority  decision  if 

1l12,,,1r 

2m~r_1.  ]  or  fewer  errors  occurred.  All  of  the  (^)  information  digits 

of  the  form  a..  .  can  be  determined  by  this  way. 

1 1 1 2  •  •  • 1  r 

After  the  ("J)  information  digits  of  the  form  a.  ,  have  been 
r  'T'^r 
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determined,  the  summation  E  a.  .  .  v.  v.  ...v.  can  be  subtracted 

V2***V  ’i  '2  V 

from  the  received  vector.  Then  the  modified  received  vector  can  be 
treated  as  if  it  were  coded  from  an  (r-l)-th  order  code  and  each 

of  the  (  )  information  digits  of  the  form  a,  •  can  be 

r~  'r  ” 'r-l 

determined  from  a  majority  decision  on  a  set  of  2m"r+^  independent 
determinations.  Then  the  procedure  continues  until  the  modified 
received  vector  is  treated  as  if  it  were  coded  from  a  0-th  order  code 
and  aQ  is  determined. 

The  procedure  for  decoding  the  punctured  RM  codes  is  similar  to 

that  for  decoding  the  RM  codes.  To  determine  a.  .  .  ,  there  are 

1 1 ’2“  -1r 

dp  independent  determinations  that  can  be  formed.  After  all  of  the 
(p)  information  digits  of  the  form  a^  ^  ^  have  been  determined  by 

a  majority  decision,  the  summation  term  l  a.  .  .  v.  v.  ...v.  is 

’lY'^r  M  7  V 

subtracted  from  the  received  vector.  The  modified  received  vector 
can  be  treated  as  if  it  were  coded  from  a  punctured  (r-l)-th  order 
RM  code.  Then  the  decoding  procedure  continues  in  a  similar  way  as 
in  the  RM  codes  until  aQ  is  determined. 

3.  The  Shortened  RM  Codes 

Consider  the  submatrix  of  Gr  formed  from  Vg,  v^,  v^ . v 

and  their  vector  products  taken  r  or  fewer  at  a  time,  where  p  <  m. 
That  is. 
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V1V2 


VP-1VP 

V1V2V3 


vp-r+l * ' *vp 


p  <  m 


(4) 


Nevt,  consider  the  columns  in  6  of  (2)  that  all  have  0’s  in 
the  last  m-p  rows.  It  is  clear  that  these  columns  form  an  additive 
group.  Furthermore,  consider  the  corresponding  columns  in  the  matrix 
Gr<  All  of  the  rows  except  those  rows  in  Gg  have  0‘s  in  these  columns 

Therefore,  if  we  delete  from  G„  the  submatrix  G„  and  the  columns  that 

r  s 

all  have  0‘s  in  the  last  m-p  columns  of  G,  the  minimum  distance  of 
the  shortened  code  will  remain  the  same.  Thus,  the  shortened  r-th 
order  RM  code  as  constructed  above  has  the  following  parameters: 


dimension  k$  =  k  -  (1  +  (?)  +  (jj)  +  .  .  .  +  (£)) 

•  S  [(?)  -  <?)] 
i=0  1  1 

code  length  n$  =  n  -  2P 

=  2m  -  2P 

minimum  distance  d$  =  d  =  2m“r 
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y 

where  p  <  m,  and  the  convention  that  (  )  =  0  for  y  >  x  is  used. 

Notice  that  the  number  of  parity  check  digits  of  the  RM  code 
is  equal  to  n-k,  and  that  of  the  shortened  code  is  equal  to 
r 

n-k-(2p  -  z  (!?)).  Therefore,  the  number  of  parity  check  digits  of 
i-0  1 

P  Q 

the  shortened  codes  is  reduced  by  I  ( .)  while  the  minimum  distance 

i=r+l  1 

remains  the  same. 

Recall  that  there  are  2  independent  determinations  that  can  be 
formed  to  solve  a.  .  .  in  a  code  word  of  the  r-th  order  RM  code. 

'1  '2***V 

If  we  delete  the  submatrix  G„  from  the  matrix  G,  the  columns  of  G 

s 

can  still  be  grouped  into  2  disjoint  sets  of  2  each,  such  that 
the  sum  of  the  columns  in  each  set  has  a  "1"  only  in  the  row 
corresponding  to  nonzero  v.  v.  ...v.  .  From  the  way  we  shortened 

’l  ’2  V 

the  RM  codes,  it  can  be  seen  that  the  nonzero  vector  v.  v,  ...v. 

’l  ’2  V 

has  zero's  at  those  positions  corresponding  tc  the  columns  we 
deleted  from  Gr>  Therefore,  the  columns  of  the  generator  matrix  of 

the  shortened  code  can  also  be  grouped  into  2m"r  disjoint  sets  such 
that  the  sum  of  the  columns  in  each  set  has  a  "1"  only  in  the  row 
corresponding  to  v.  v.  ...v.  .  Thus,  a,  .  .  can  be  determined 

’l  '2  V  ’lY-'V 

m**  r 

by  a  majority  decision  on  a  set  of  2  independent  determinations. 
After  all  the  C™  -  Cp  information  digits  of  the  form  ai  ^  have 

been  determined,  the  sum  Z  v.  v.  ...v.  a.  .  .  is  subtracted  from 

’l  '2  V  1l12*’*1r 
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the  received  vector.  Then  the  modified  received  vector  is  treated  is 
if  it  were  coded  from  a  shortened  ( r- 1 ) - th  order  code.  By  a  similar 

argument,  all  the  C^_-j  -  C^_-j  information  digits  of  the  form 

a-  •  •  can  be  determined  by  majority  decisions.  Then  the  decoding 

procedures  continue  until  ap+^  is  determined.  Thus,  the  shortened 
RM  codes  are  majority  logic  decodable. 
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APPENDIX  A 


SCIENTIFIC  REPORT  NO.  1  AFCRL-70-0325 

ON  MAJOR  I TY -LOGIC  DECODING  FOR  THE  DUAL  OF  PRIMITIVE  POLYNOMIAL  CODES  - 

nmrmmr,  shu  m  -  mav  20,  1970 

The  class  of  polynomial  codes  introduced  by  Kasami  et  al.  ^as  coi.-- 
siderable  inherent  algebraic  and  geometric  structure.  It  has  I  'n 
shown  that  this  class  of  codes  and  their  dual  codes  contain  man  im¬ 
portant  classes  of  cyclic  codes  as  subclasses,  such  as  BCH  codes,  Reed- 
Solomon  codes,  generalized  Reed-Muller  codes,  projective  geometry  odes 
and  Euclidean  geometry  codes. 

The  purpose  of  this  paper  is  to  investigate  further  proper' ies  of 
polynomial  codes  and  thei  ■  duals.  First,  majority-logic  decoding  for 
the  duals  of  certain  ^rir  i ti ve  polynomial  codes  is  consider*  d.  Tvr 
methods  of  forming  non-r  thogonal  parity-check  sums  are  presented. 
Second,  the  maximality  of  Ejclidean  geometry  codes  is  proved.  The  roots 
of  the  generator  polynomia'  of  an  Euclidean  geometry  code  are  specified. 


SCIENTIFIC  REPORT  NO.  2  AFCRL-70-0430 

ON  THE  CONSTRUCTION  OF  A  CLASS  OF  MAJORITY-LOGIC  DECODABLE  CODES  - 

tmO  KASART.'W LIN  -  JUNE  15,  1970 - 

The  attractiveness  of  majority-logic  decoding  is  its  simple 
implementation.  Several  classes  of  majority- logic  decodable  block  codes 
have  been  discovered  for  the  past  two  decades.  In  this  paper,  a  method 
of  constructing  a  new  class  of  majori ty- logic  decodable  block  codes  is 
presented.  Each  code  in  this  class  is  formed  by  combining  majority- 
logic  decodable  codes  of  shorter  lengths.  A  procedure  for  orthogonal i zing 
codes  of  this  class  is  formulated.  For  each  code,  a  lower  bound  o<  the 
number  of  correctable  errors  with  majority-logic  decoding  is  obtained. 

An  upper  bound  on  the  number  of  orthogonal ization  steps  for  decoding  each 
code  is  derived.  Some  majority-logic  decodable  codes  which  have  more 
information  digits  than  the  Reed-Muller  codes  of  the  same  length  and  the 
same  minimum  distance  are  found. 

Some  results  presented  in  this  paper  are  extensions  of  the  results 
of  Lin  and  Weldon  and  Gore  on  ~he  majority-logic  decoding  of  direct 
product  codes. 
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T.  Kasami  and  S.  Lin,  "On  Majority-Logic  Decodin]  for  the  Duals  of 
Polynomial  Codes",  To  appear,  IEEE  Trans,  on  Information  Theory,  IT-17, 
1971. 

T.  Kasami  and  S.  Lin,  "On  the  Construction  of  a  Class  of  Majority-Logic 
Decodable  Codes,"  Submitted  to  IEEE  Trans,  on  Information  Theory. 
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This  final  report  summarizes  research  for  a  one-year  project. 
Abstracts  for  the  two  scientific  reports  are  given,  and  some  new 
results  are  included  on  reduction  of  context-free  grammars,  decoding 
binary  block  codes  on  Q-ary  output  channels,  a  procedure  for  decoding 
binary  product  codes,  on  the  minimum  weight  code  words  or  a  certain 
class  of  cyclic  codes,  distance  property  of  the  dual  codes  of 
polynomial  codes  and  on  shortened  Reed-Muller  codes. 
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